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ABSTRACT 


The  construction  of  D-optlmal  designs  for  multiresponse 
experiments  was  considered -by  Fedorov  (1972,  Ch.  5).'’  His 
algorithm  required  that  the  variancercovariance  matrix,  of  Che 
responses  be  known.  This  is  rarely  the  case  in  practice.  The 
primary  objective  of  this  paper  is  to  develop  a  sequential 
procedure  for  the  construction  of  multiresponse  designs  when  is 
not  known.  Several  numerical  examples  are  given  to  illustrate 


^  — i 

M 


.•> 


this  procedure. 


'C::j 


1.  MODEL  AND  NOTATION 


We  consider  a  situation  in  which  observations  are  made  on 


:1j 


r(>2)  responses  at  N  experimental  runs  (not  necessarily  all 


distinct)  such  that  the  ith  response  is  represented  by  the  linear 
model 


y^i  =■  "ui*  1  -  u  -  (1) 

Here  is  the  observation  on  the  ith  response  at  the  uth  design 

setting;  S.  (i  ■  l,2,...,r)  is  a  vector  of  p.  unknown  parameters 

associated  with  the  ith  response  oxsdel;  is  a  random  error  in 

the  ith  response  value  at  the  uth  experimental  run;  « 

(x  ,x  , . . .  ,x  )■"  represents  the  uth  design  settings  of  k  con¬ 
'll  “2  \ 

trollable  variables  (u*l ,2 , . . - ,N)  within  some  experimental  region, 
X,  considered  to  be  a  compact  subset  in  the  k-dlmensional 
Euclidean  space  and,  is  a  p^xl  vector  whose  elements  are 

known  functions  of  the  controllable  variables  assumed  to  be 
continuous  within  x*  Th®  set  of  points  XpX2,«**,x^  (not 
necessarily  distinct)  form  an  N-polnt  design  which  we  denote  by 
0^.  Using  matrix  notation,  model  (1)  can  be  written  as 

~1*  -iJ^i  *  ^  *  1,2,. ..,r,  (2) 

where  is  the  Nxl  vector  of  observations  on  the  1th  response, 

is  an  Nxp^  matrix  of  full  column  rank  whose  uth  row  contains  the 

elements  of  1^(5^)  (u*l  ,2, . . .  ,N) ,  and  is  an  Nxl  vector  of 

random  errors  associated  with  the  ith  response  (i»l ,2 , . . . ,r)  with 

the  assumption  that  E(Sj)-Q  and  E(e.e')  ■  a..l  ( i , i»l ,2 , . . .r) , 

1  Ij^-N 

where  is  the  Identity  matrix  of  order  NxN.  Thus,  the  variance- 
covariance  matrix  of  the  Nrxl  vector  £»(£',£',..•  is  given  by 

the  direct  product 

var(g)  *  E  9 

where  E»(o  )  is  the  variance-covariance  matrix  for  the  r 
■'  ij 

responses.  The  r  models  in  (2)  can  be  written  as 


(3) 


where 


r  =  •  r  =  [S^S2..-..6;]  ,  -  [e'.e',...,e;j 


and  Fj^  is  the  block-diagonal  matrix  diagffp 


the  total  number  of  unknown  parameters  in  the  system  is  p*  2  p  , 

i  =  l 


Since  each  is  of  full  column  rank,  jfp  is  also  of  full  column 
rank  equal  to  p.  The  best  linear  unbiased  estimator  of  ^  is  then 
given  by 

"“i  a  T  \ri  /  c""  ^ 


6 


(J  ‘  9  !,)£„  r  rj  d  9  i„)I. 

N  N  N 


(5) 


The  variance-covariance  matrix  of  ^  is 

-1  «  ,  1-1 


=  [F'  9  I  )F  ]■ 

N  N 


(6) 


At  a  point  x  «  (xpX2 ,  • .  •  ,x^^) "  in  the  experimental  region  x» 


vector  of  predicted  responses,  Y(x)  ■  [yj^(x)  .y2(jf)  >  •  •  •  j""* 

can  be  expressed  as 


(7) 


where  p'(x)  is  the  block-diagonal  matrix  diag f f '(x) ,f '(x) , . . . , 

f'(x)^.  The  variance-covariance  matrix  of  Y(x)  is  then  of  the  fo 
r  ^  ^ 


rin 


N  N 


i-l 


(8) 


2.  DESIGN  THEORY 


The  concept  of  a  design  measure  as  defined  below  is  important 
to  the  theory  of  optimal  designs. 


Definition  I 


A  design  measure  defined  on  an  experimental  region  x  is  a 
probability  measure  Z(x)  which  satisfies  C(x)  >  0  and  '  d;:(x)  =  1, 


X  s  X  (see  Wynn,  1970;  Fedorov,  1972).  Given  a  design  measure 

CCx)  on  x»  Che  set  of  points  x  e  x  sc  which  cCx)  >  0  is  called  the 

support  or  spectrum  of  ?(x).  For  example,  for  XpX2 . x^  e  X. 

C(x)  may  be  defined  as 

0  x^x  u“l,2,...,s 

A 


\  x*x  u“  1,2, ...,8 
u  -'U 


such  that  2  X  *  1  with  0  <  \  <1.  This  measure  is  discrete  if 

1-1 

is  a  rational  number  for  u  -  l,2,...,s,  otherwise,  if  at  least 
one  X^  is  an  irrational  number,  then  C(x)  is  a  continuous 
measure.  In  particular,  we  define  the  discrete  measure  C_  (x)  by 

U 

N 


0  x^x^,  u-  1,2,.. .,3 


X  -  X  ,  u  »  1,2,... ,s, 
N  'ni  ’  '  ’  '  ’ 


where  is  the  number  of  replications  at  the  point  and 
s 

2  n  »  N.  For  a  given  design  measure  c(x)  and  a  given  variance- 
1  u  ^ 

u*l 

covariance  matrix  £,  we  define  the  moment  matrix  M(!:,2)  as 

M(i:,p  -  /  (10) 

X 

where  |(x)  is  the  block  -diagonal  matrix  in  (7).  In  particular, 
for  the  discrete  design  measure  (x)  described  earlier. 


-i)  ■?  Vai<5„> 


or  equivalently. 


where  F  is  Che  block-diagonal  matrix  in  (4). 

2. 1  D-Opclmality 

Under  Che  assumption  of  normality  of  errors  and  linearity  of 
Che  fitted  models,  a  confidence  ellipsoid  for  3  of  a  given 
confidence  coefficient  is  of  the  form 

C,E)(j§-^)  <  constant  },  (13) 

where  M(?,E)  is  as  defined  in  (10)  and  f  is  the  weighted  least 
squares  estimator  of  ^  given  in  (5)  (see  Silvey,  1980,  p.  10  for 
the  single  response  case).  A  more  precise  estimate  for  ^  is  thus 
obtained  by  making  Che  volume  of  this  ellipsoid  as  small  as  pos- 

I  I-  Vt 

sible.  Since  this  volume  is  proportional  to  |‘i(C,^)j  where 

1 . 1  denotes  Che  determinant  of  a  matrix,  we  can  achieve  this 
objective  by  choosing  a  design  measure  which  maximizes  jM(c,E)|. 
Such  a  design  measure  is  said  to  be  D— optimal.  More  formally,  if 
H  is  Che  class  of  all  design  measures  on  x*  then  C*  €  H  is  D- 
optlmal  with  respect  to  J  if 

|m(C*,|)|  -  sup  |m(c,|)|.  (14) 

CeH 

In  addition  to  improving  Che  precision  of  S,  continuous  D- 
optimal  design  measures  have  the  desirable  property  of  minimizing 
Che  maximum  of  the  variance  of  the  predicted  response  over  the 
experimental  region  x*  This  latter  property  is  Che  G-optimality 
criterion.  The  equivalence  of  the  D-optimality  and  G-optimality 
criteria  was  first  proved  by  Kiefer  and  Wolfowicz  (1960)  for  the 
single-response  c^se.  An  extension  of  their  theorem  to  the  multi- 
response  case  was  proved  by  Fedorov  (1972,  p.  212). 

3.  THE  CONSTRUCTION  OF  D-OPTIMAL  DESIGNS  WHEN  J  IS  NOT  KNOWN 

In  Che  mulciresponse  extension  of  the  Kiefer  and  Wolfowicz 
(1960)  Equivalence  Theorem  as  given  by  Fedorov  (1972,  p.  212),  the 
following  assertions  are  equivalent: 


(i)  The  design  measure  C*  is  D-optimal. 


(li)  The  design  measure  C*  is  G-optiraal,  that  is,  it 

minimizes  max  tr[C  y(x,C,2)],  ceH. 
xex 


(iii)  max  tr[Z  y(x,?*,Z)]  -  p 

xex 


where 


^  ^  X.  Ce3. 


and  where  ^(j)  and  M(?,£)  are  the  same  matrices  as  in  (10),  and  p 
is  the  total  number  of  parameters  in  the  multiresponse  model.  It 
is  to  be  noted  that  if  Y(j)  is  the  vector  of  predicted  responses 
given  in  (7),  and  if  the  design  measure  is  discrete,  then  the  ma- 

A 

trix  Y(x,C,r)  is  related  to  var[Y(x)]  according  to  the  expression 


.P  -  N  var[Y(x)]. 
N 


We,  therefore,  refer  to  V(x,?,Z)  as  the  prediction  variance 
matrix.  On  the  basis  of  this  equivalence  theorem,  Fedorov  (1972, 
Ch.S)  developed  an  iterative  procedure  to  construct  a  multlreponse 
D-optlmal  design  provided  that  %  is  known.  The  main  steps  of  his 
procedure  are  as  follows  f for  convenience,  throughout  the  remain¬ 


der  of  this  paper,  we  shall  write  Cm  instead  of  Cn  denote  a 
discrete  design  measure  as  in  (9)1: 


(i)  An  Initial  nondegenerate  design  D„  ,  that  is,  a  design 


for  which  M( c  ,Z)  is  nonsingular,  is  chosen.  The 
-  Nq  - 


design  measure  is  defined  by  assigning  the  weight 


1/Nq  to  each  point  in  Dj^ 


(li)  A  design  constructed  from  +f}_i(N>l)  by 


I  f 

r.  <r-.  r-^» 


i 


I 


augmenting  it  with  the  point  which  satisfies 

C  . ^) ]  *  tT\Z  ^V(x,5„ 

crii  i^5NQ+N’^NQ+N-r-^  J  ^  ^  Nq+N-1  ~ 

where  V  is  the  matrix  defined  in  (15),  and  the  design 


measure  defined  by  assigning  the  weight 

1/(Nq+N)  to  each  point  in 

The  stopping  point  for  this  procedure  is  reached  when  an  integer 
>J'>1  satisfying 

max  tr[Z  “  P  <  ° 

xex  ‘0 

is  found,  where  5  is  a  small  positive  number  chosen  a  priori.  In 

other  words,  the  procedure  stops  when  max  tr  [ yCx,Zy  j  is 

X£X  ‘  0 

sufficiently  close  to  p.  This  is  based  on  Assertion  (iii)  of  the 

Equivalence  Theorem  by  Fedorov  (1972)  and  noting  that  by  Assertion 

(ii),  p  is  the  minimum  value  of  max  tr[Z  which  is 

X€X 

attained  when  the  design  measure  is  D-optimal. 

The  above  procedure,  however,  requires  knowledge  of  £.  If  £ 
is  not  known,  a  consistent  estimator  of  ^  can  be  used  to  construct 
a  sequence  of  design  measures  which  converges  in  probability  to  a 
D-optimal  design  measure  with  respect  to  A  consistent 
estimator  of  £  was  proposed  by  Zellner  (1962)  and  is  given  by 

^  -  r  1 ,  where 

*  ^^i’  . 

where  F  is  the  Nxp  matrix  in  (2),  and  8  is  the  ordinary  least 
squares  estimator  ^1-i  *  l,2,...,r)  based  on  the  ith 

individual  response  model  in  (2).  We  now  define  the  matrix  as 

A  -  [diagfZ  ^1]  1  ^[diagi'E  ^ .  d') 


The  following  theorem  (Wijesinha,  1984,  Appendix  D)  implies  that  a 


D-optimal  design  measure  wich  respect  to  J  is  equivalent  to  a  D- 
optimal  design  measure  with  respect  to  A  ^ : 


Theorem  I.  If  M(C,2)  is  the  moment  matrix  in  (10),  then 

|M(^,pj  »  n  ,  C€H,  -  (a^^), 

i»l 

where  H  is  the  class  of  all  design  measures  defined  on  the  region 
X.  It  can  be  seen  from  the  expression  on  the  right-hand  side  that 
only  ^)j  depends  on  the  design  measure  C*  Hence,  a  design 

measure  maximizes  jM(?,A  ;|  if  and  only  if  it  maximizes  |M(!;,p|. 
It  follows  that  Fedorov's  (1972)  sequential  procedure  to  obtain  a 
D-optimal  design  measure  can  be  applied  with  £  replaced  by 

When  and  hence  A,  is  unknown,  we  can  modify  Fedorov's 
procedure  so  that  A  is  replaced  by  the  estimate 

i;;' 

where  is  Zellner's  (1962)  estimate  of  {  as  given  in  (16).  A 
sequential  procedure  is  introduced  In  Section  3.1  for  the 
construction  of  a  D~optimal  design  in  this  case  whereby  ^  is 
reevaluated  at  each  stage  of  the  procedure.  In  Appendix  E  in 
Wtjeslnha  (1984)  it  is  shown  that  ^  is  a  consistent  estimator  of 
&• 

The  construction  of  a  D-optlmal  design  with  respect  to 
(instead  of  f)  is  more  desirable  for  two  reasons 

(i)  Since  the  elements  of  A  lie  between  -1  and  1,  it  is 
expected  that  ^  reaches  stability  much  faster  than 
thereby  giving  rise  to  a  rapidly  convergent  D-optimal 
design  measure  in  the  sequential  procedure. 

(ii)  Since  the  diagonal  elements  of  ^  are  equal  to  unity,  the 
number  of  elements  of  ^  to  be  estimated  is  reduced  by  r. 


3.1  The  Sequential  Procedure  l^hen  ^  Is  Not  Known 

(i)  Start  with  an  Initial  design  such  that  M( I  ) 

’N„’-r 


is  nons ingular , where  is  Che  identity  matrix  of  order 


(ii)  Once  N  >  1,  is  obtained, 

(a)  compute  ^nd  ^  +f4~i  basis  of  the 

0  ‘  ‘  0  ‘ 

observations  on  all  r  responses  measured  at  Che 
points  of  using  (16)  and  (18), 

(b)  construct  the  design  measure  +N-1  assigning 

■  0 

the  weight  1/(Nq+N-1)  to  each  point  in 

(iii)  Construct  by  augmenting  with  the  point 

X.,  which  satisfies 

■'Nq+N 

S.+N-l’  -N.+N-l^J 

0  0  0  0 

=  tr[A  ^_jy(x,  C.  ^^_j)j, 

xex  0  0  0 

where  Y  is  the  prediction  variance  matrix  in  (15). 

(iv)  Continue  this  procedure  until  an  integer  N'(>1)  is 
reached  such  that 


tnax  tr[Ajj  ^.,-_lY(x,  a'  -  P  <  6 

x€  X  0  0  0 

where  5  is  a  small  positive  number  chosen  a  priori,  and 
p  is  the  total  number  of  parameters  in  the  mulciresponse 
model . 

In  Wljesinha  (1984)  it  is  shown  chat  the  above  sequential 
procedure  converges  to  a  D-optimal  design.  More  specifically,  let 
A  be  Che  set  of  all  rxr  symmetric  matrices  A  “  ^^ij^  such  chat 
=  1,  i  »  l,2,...,r,  and  -1  <  a^^  <;i,  l<;i<j<r.  Define 
b(A)  «  (bj ,62 , . . . ,b^-) ' ,  where  r'  =  r(r-l)/2.  This  vector 
consists  of  Che  elements  of  A  above  its  diagonal  taken  in  order 
from  left  to  right  for  each  row  starting  with  the  first.  We  call 
b(A)  Che  r '-dimensional  vector  associated  with  A.  Note  chat  since 
A -;A  is  symmetric  and  all  its  diagonal  elements  ire  enual  to  I,  A 


can  be  completely  described  by  the  r'  elements  ,  1  <  i  <  j  < 
r'.  It  is  clear  that  4  and  ^  defined  in  (17)  and  (18), 

respectively,  belong  to  A.  Since  ^  is  a  consistent  estimator  of 

A  (Wijesinha,  1984,  Appendix  E),  then  e^^  converges  in  probability 

A  A 

to  0,  where  e^j  is  the  Euclidean  distance  between  jj(^)  and  b(A). 

It  is  conjectured  that  the  convergence  in  probability  to  0  of 

e^j  is  sufficient  for  the  above  sequential  procedure  to  converge. 

However ,  we  were  only  able  to  prove  convergence  by  assuming  a 

N  . 

stronger  condition,  namely  that  converges  in  probability  to 

some  random  variable  e.  This  can  be  formally  stated  as  follows: 

N  . 

Theorem  2.  Suppose  that  converges  in  probability  to  some 

random  variable  e.  Then  for  a  given  6  >  0,  there  exists  an 
integer  N  >  0  such  that 

S’  -  p  <  <s 

with  probability  1.  The  proof  of  this  theorem  is  given  in 
Wijesinha  (1984).  It  is  fairly  long  and  will  not  be  Included  in 
this  paper. 

EXAMPLES 

In  this  section  we  present  some  examples  to  Illustrate  the 
procedure  described  in  Section  3.1.  In  each  example  J  is  pre¬ 
determined  and  the  error  vector  (assumed  to  be  normally  distrib¬ 
uted  with  a  zero  mean  vector  an  a  variance— covariance  matrix 
given  by  the  direct  product  of  £  with  the  identity  matrix  of  a 
proper  order)  is  computer  generated.  At  the  Nth  (N  >  1)  stage, 
the  (i,j)th  element  of  the  matrix  described  in  (16)  is 

calculated  using  the  formula  ® 


•  1  <  i,  j  <  r, 


(19) 


.N  +N-1 

(VN-l) 


where  R.  *  F.(F^F.)  F,  and  F.  is  of  order  (N^+  N-1)  x  p 
(i  »  l,2,..,,r).  The  (i,j)ch  element  of  the  corresponding 


matrix  Is  determined  from  (18)  after  substituting 


for  E^.  It  should  be  noted  that  although  the  matrix  X  is 

used  to  generate  the  error  vector  e,  it  is  not  used  in  the 
sequential  generation  of  the  D-optimal  design.  In  an  actual  ex¬ 
perimental  situation,  observed  response  values  would  be  available, 
.N  +N-1 

hence,  should  be  calculated  using  (16)  instead  of  (19). 


In  all  the  examples  we  have  considered,  the  final  value  of 

':r[^  +N-1-^-’  S  +N-1’  ^  +N-pl  stopping  rule 

xg  X  0  0  0 

described  in  Theorem  2  for  a  value  of  5  determined  a  priori. 


Example  1 .  Consider  an  experiment  involving  three  responses  and 
three  controllable  variables.  The  experimental  region 
X  “  {x  “  (Xj ,X2 .x^) : |x^ I  <  1,  i  ■  1,2,3}  and  the  fitted  models  are 


^1  “  ®10  ^ll’^l  ^12*2  *  ^1 

Yl  -  620  +  ^21^1  *  ®22*2  ®23*3  ^2 

^3  ”  ®30  ®31^1  ®32*2  ^3* 

When  all  the  models  are  linear,  tr[A  ^y(x,;,A”S]  for  x  g  x» 


and  ^€k  is  a  convex  function  in  x.  and  since  x  f®  a  convex  set, 
max  tr[A  ^y(x»C»A  ^)]  will  occur  on  one  of  the  extremal  points  of 

X.  Therefore,  the  search  for  additional  support  points  of  the  D- 
optimal  design  was  restricted  to  the  vertices  of  x-  Also,  all  the 


points  of  Che  initial  design  were  chosen  to  be  extremal  points 
(see  Table  1).  For  this  example  X  was  chosen  as 


3.000  .030  1.600 

I  m  .030  ,600  .800 

1.600  .800  3.300 


Therefore , 


.524  .462 

.462  2.870 

-.366  -.920 


TABLE  I 

THE  INITIAL  DESIGN  (EXAMPLE  1) 


TABLE  2 

THE  AUGMENTED  DESIGN  POINTS  FOR  A  D-OPTIMAL  DESIGN  (EXAMPLE  1) 


Nq^-N 

■««  V(j,  5  .J,  a'  ): 

xex  0  00 

i 

X2 

X3 

6 

22.1429 

-1 

-1 

-1 

7 

14.0000 

-1 

1 

-1 

8 

15.4000 

1 

-1 

-1 

Table  2  displays  the  augmented  support  points  and  corresponding 
max  trace  values.  Using  the  design  consisting  of  the  five  initial 
design  points  in  Table  1  and  the  three  augmented  design  points  in 

Table  2,  it  was  found  that  max  cr[Ag  Y(x,  Cg,  Ag  )]  was  equal  to 

xex 

10.  The  fast  drop  in  the  max  trace  function  to  its  anticipated 
value  of  p“10  in  this  example  is  quite  noteworthy. 

In  the  following  examples  the  maximization  with  respect  to  jc 
of  the  trace  function  at  every  iteration  was  carried  out  using  a 
computer  program  based  on  the  controlled  random  search  procedure 
introduced  by  Price  (1977).  The  procedure  uses  a  random  search  to 
locate  an  optimal  point  from  among  a  collection  of  points,  the 
number  of  which  is  determined  by  the  user. 


Example  2.  In  this  example  we  have  two  responses  and  two 
controllable  variables.  The  experimental  region  is 
X  =•  {x  *  (XpX^):  x^  +  x^  <  2 } ,  and  the  fitted  models  are 


6io  +  S^^x^  +  0^2*2  *  ®ll2*l’'2  *  ^1 


020  +  82iXj  +  022X2  +  B212’'l*2  ®21l’'l 


®222*2  ^2‘ 


Thus  p  »  10.  The  points  for  the  initial  design  were  arbitrarily 
chosen  and  are  given  in  Table  3.  The  matrix  X  is  given  the  value 


TABLE  3 

THE  INITIAL  DESIGN  (EXAMPLE  1) 


^1 

X2 

1.0 

1.0 

1.0 

-1.0 

-1.0 

1.0 

-1.0 

-1.0 

0.0 

0.5 

0.5 

0.0 

0.0 

0.0 

TABLE  4 


THE 

AUGMENTED  DESIGN  FOR  A  D-OPTIMAL 

DESIGN 

(EXAMPLE 

2) 

Nq+N 

max 

*1 

X2 

x^  +  x; 

8 

257.7074 

0.0137 

-1.414 

1.999 

9 

28.3742 

-1.414 

-0.095 

2.000 

10 

20.9817 

1.409 

-0.122 

2.000 

11 

20.0266 

-0.025 

1.414 

2.000 

12 

13.9047 

1.029 

0.969 

2.000 

13 

14.4880 

-1.009 

0.991 

2.000 

•  14 

14.8490 

-1.002 

-0.997 

1.999 

15 

15.0983 

0.939 

-1.057 

2.000 

16 

11.1210 

-1.127 

0.847 

1.987 

17 

11.8267 

0.746 

1.201 

2.000 

18 

12.2723 

-0.911 

-1.081 

2.000 

19 

12.6633 

1.391 

-0.252 

1.999 

20 

12.5054 

0.475 

-1.332 

2.000 

21 

11.1222 

-1.376 

-0.327 

2.000 

22 

11.3869 

-0.793 

1.170 

1.999 

23 

11.5757 

0.968 

1.030 

2.000 

24 

11.0369 

1.136 

-0.837 

1.991 

25 

10.0579 

-0.033 

-0.033 

0.002 

As  shown  in  Table  A,  max  cr[A2^y(x,  ^24*  ^24^*'  satisfies  the 

stopping  rule  in  Theorem  2  with  5*  .06.  We  conclude  that  the 
design  points  in  Table  4  together  with  the  initial  design  points 
form  a  nearly  D— optimal  design.  In  Table  5  we  can  see  the  change 
in  the  values  of  the  elements  of  the  ~  matrices. 

TABLE  5 

THE  ESTIMATES  FOR  E,  and  A  (EXAMPLE  2) 

*  «  «  *22 
N^+N-1  a..  a,-,  Ooo  0  -a. 


7 

.258 

.030 

.078 

4.061 

1.551 

13.477 

.211 

8 

.275 

.080 

.385 

3.872 

0.807 

2.767 

.24 

9 

.266 

.  131 

.418 

4.447 

1.396 

2.832 

.39 

10 

.519 

-.052 

.532 

1.945 

-0.189 

1.899 

.091 

11 

.577 

.162 

1.213 

1.801 

0.240 

0.857 

.19: 

12 

.772 

-.024 

1.215 

1.296 

-0.026 

0.823 

.02 

13 

.713 

-.028 

1.197 

1.404 

-0.032 

0.836 

.031 

14 

.669 

.125 

2.352 

1.510 

0.081 

0.430 

.lOi 

15 

.622 

.091 

2.305 

1.617 

0.064 

0.436 

.07. 

16 

.757 

.125 

2.164 

1.333 

0.077 

0.467 

.09 

17 

.710 

.128 

2.096 

1.425 

0.087 

0.482 

.  10 

18 

.828 

.494 

2.903 

1.338 

0.223 

0.382 

.31 

19 

.831 

.720 

3.514 

1.462 

0.299 

0.346 

.42 

20 

.816 

.660 

3.343 

1.459 

0.288 

0.356 

.401 

21 

.525 

.414 

3.005 

2.137 

0.295 

0.374 

.331 

22 

.753 

.515 

3.270 

1.489 

0.235 

0.343 

.32 

23 

.808 

.485 

3.368 

1.353 

0.195 

0.325 

.28 

24 

.760 

.459 

3.210 

1.440 

0.206 

0.341 

.29 

Exam 

pie  3.  Here  the  responses 

and  the  controllable 

variables 

are 

the 

same  as  in 

Example 

2.  The 

experimental  region 

is 

X  =■ 

(x-(x, .x.) 

:  -^2  < 

X,  .X,  < 

/2\  and 

The  fitted  models  are 


yi  -  6^0  ^  8112*1*2 


(22) 


^2  “  820  821*1  ■*■  822*2  8212*1*2  8211*1  8222*2  ^1’ 

The  Initial  design  for  this  example  was  chosen  arbitrarily  and  Is 
given  In  Table  6. 


TABLE  6 

THE  INITIAL  DESIGN  (EXAMPLE  3) 
*1  *2 


1  1 

1  -1 

-1  1 

-I  -1 

0  -1.414 

1.414  0 

0  0 

A  nearly  D-optimal  design  for  this  example  consists  of  the 
augmented  design  points  given  in  Table  7  and  the  initial  design 
points  given  in  Table  6.  At  the  15th  iteration  (Nq  +  N  -  22  in 
Table  7)  the  stopping  rule  is  satisfied  with  S  »  .07.  The  ele- 

ments  of  ,  and  a  at  these  Iterations  are  given  in  Table  8. 


TABLE  7 

THE  AUGMENTED  DESIGN  POINTS  FOR  A  D-OPTIMAL  DESIGN  (EXAMPLE  3) 


+N 

xeX  0 

Sq+N-1’  ^jj+N-1^' 

^1 

X2 

8 

39.0014 

-1.414 

1.414 

9 

45.5963 

-1.414 

-1.414 

0 

41.6899 

1.414 

-1.414 

1 

33.3881 

1.414 

1.414 

2 

15. 1616 

-1.414 

-1.414 

3 

15.9091 

1.414 

-1.414 

u 

17.1823 

-1.414 

1.414 

5 

14.8294 

0.059 

-1.414 

5 

17.6392 

1.414 

1.414 

7 

14.1912 

-1.414 

0.002 

3 

12.4739 

-1.414 

-1.414 

9 

13.0994 

-1.414 

1.414 

9 

13.7740 

1.414 

1.414 

( 

14.3783 

1.414 

-1.414 

> 

10.0685 

-1.405 

1.384 

TABLE  8 

THE  ESTIMATES  FOR  I,  AND  A  (EXAMPLE  3) 


Nq+N. 

-1 

^11 

Oi2 

CM 

CM 
<  D 

Q  > 

-;i2 

;22 

A 

-ai2 

7 

.347 

.821 

2.390 

15.457 

5.311 

2.243 

.902 

8 

.314 

.745 

2-111 

19.429 

6.857 

2.893 

.914 

9 

.366 

.656 

1.888 

7.218 

2.507 

1.400 

.789 

10 

.743 

.373 

1.863 

1.496 

0.300 

0.597 

.317 

11 

.694 

.405 

1.753 

1.666 

0.385 

0.659 

.367 

12 

.701 

.277 

1.705 

1.525 

0.248 

0.627 

.254 

13 

.643 

.280 

1.577 

1.685 

0.299 

0.687 

.278 

14 

.671 

.563 

2.884 

1.781 

0.347 

0.414 

.404 

15 

.634 

.553 

2.716 

1.917 

6.390 

0.448 

.421 

16 

.738 

.506 

2.526 

1.571 

0.314 

0.459 

.370 

17 

.977 

.856 

3.166 

1.342 

0.363 

0.414 

.487 

18 

.815 

.855 

3.607 

1.634 

0.387 

0.369 

.499 

19 

.816 

.950 

3.906 

1.708 

0.415 

0.357 

.532 

20 

.791 

.880 

3.714 

1.717 

0.407 

0.366 

.513 

21 

.759 

.823 

3.546 

1.762 

0.409 

0.377 

.502 

4.1 

Choice  of  the  Initial  Design. 

It  is  interesting  to  note  that  in  the 

above 

examples , 

most  of 

the  augmented  support  points  of  the  D~optlinal  designs  are  boundary 
points  of  the  experimental  region.  This  suggests  that  the 
boundary  of  the  experimental  region  may  be  an  optimal  location  for 
the  support  points  of  a  D-optimal  design.  Therefore,  boundary 
points  of  X  can  be  appropriately  chosen  as  initial  design  points. 
In  order  to  investigate  this  possibility.  Example  3  was  again 
considered  with  tn  initial  design  consisting  of  boundary  points  of 
X.  The  results  given  in  Example  4  below  indicate  that  the  use  of 
the  new  initial  designs  can  reduce  the  number  of  iterations 
required  for  Che  convergence  of  the  procedure. 


Example  4.  The  models,  che  experimental  region,  and  the  value  of 
I  for  this  example  are  as  in  Example  3.  The  Initial  design  is 
given  in  Table  9. 

TABLE  9 

THE  INITIAL  DESIGN  (EXAMPLE  4) 


’'I 

X2 

1.414 

1.414 

1.414 

-1.414 

-1.414 

1.414 

-1.414 

-1.414 

0.000 

1.414 

1.414 

0.000 

0.000 

-1.414 

This  example  shows  that  the  use  of  an  initial  design  con¬ 
sisting  of  boundary  points  of  x  reduces  the  number  of  iterations 
required  to  stop  the  procedure.  The  stopping  rule  was  first 
satisfied  with  5  ■  .02  at  the  2nd  iteration  (Nq  +  N»9  in  Table 
10).  However,  the  value  of  the  max  trace  function  at  this  itera¬ 
tion  was  not  stable  enough  as  can  be  seen  from  Table  10.  This  is 
also  reflected  by  the  Lack  of  stability  in  the  values  of  Che  ele- 
ments  of  E  ,£  ,  and  A  (see  Table  11).  The  sequential  procedure 

was,  therefore,  continued  until  the  11th  iteration  (Nq+N  ■  18  in 
Table  10)  at  which  che  stopping  rule  was  satisfied  with  5  »  .06. 


The  main  advantage  of  Che  sequential  procedure  we  have 
proposed  is  that  Z  ( Che  variance-covariance  matrix  of  the 
responses)  is  not  required  to  be  known.  The  basic  idea  used  in 
the  sequential  procedure  is  to  choose  the  point  x^  which 
maximizes  Che  trace  function,  chat  is, 

^  1 

^Nq+N-1’  -Nq+N-1^^ 


max  criA  jj_^y(x,  ^  +N-i^j 

x£x  0  00 

where  Ng  is  the  number  of  points  in  the  initial  design.  The 
procedure  is  continued  until  max  tr[^  +n_i  * 

xe  X  ‘^0  ^  "0 

*- 1  ’ 

sufficiently  close  to  p. 

The  examples  described  earlier  show  chat  our  procedure  has  a 
fast  rate  of  convergence  in  chat  the  quantity 

Cr[^  ^^_iy(x,  Cj, 

X£X  0  00 

reduces  to  its  anticipated  limit,  namely  p  quite  rapidly.  In 
addition,  a  comparison  of  Che  estimated  values  of  j  ^^d 


^  ^^.^demonstrate  that  ^ 


stabilizes  much  faster.  This 


supports  the  Idea  of  using  ^  +N-1  procedure  in  place 

0 

The  examples  also  indicate  chat  the  use  of  initial  designs 
consisting  of  boundary  points  of  x  does  reduce  Che  number  of 
iterations  required  to  meet  Che  stopping  rule.  Therefore,  the 
boundary  of  Che  experimental  region  can  be  an  appropriate  choice 
for  Che  selection  of  the  initial  design  points.  It  should  be 
noted,  however,  chat  this  is  a  conjecture  based  only  on  the  above 
examples  and  has  no  theoretical  justification.  We  feel  that  this 
is  a  topic  which  should  be  investigated  in  future  research. 


.V.-.l 
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